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Abstract 



We propose a weight design method to increase the convergence rate of distributed consensus. 
Prior work has focused on symmetric weight design due to computational tractability. We show that 
with proper choice of asymmetric weights, the convergence rate can be improved significantly over even 
the symmetric optimal design. In particular, we prove that the convergence rate in a lattice graph can 
be made independent of the size of the graph with asymmetric weights. We then use a Sturm-Liouville 
operator to approximate the graph Laplacian of more general graphs. A general weight design method 
is proposed based on this continuum approximation. Numerical computations show that the resulting 
convergence rate with asymmetric weight design is improved considerably over that with symmetric 
t ' optimal weights and Metropolis-Hastings weights. 

CN 

en '. I. Introduction 

O i 

In distributed consensus, each agent in a network updates its state by aggregating the in- 
formation from its neighbors so that all the agents' states reach a common value. Distributed 
consensus has been widely studied in recent times due to its wide ranging applications such as 

b ■ 

multi-vehicle rendezvous, data fusion in large sensor network, coordinated control of multi-agent 
system and formation flight of unmanned vehicles and clustered satellites, etc. (see [l]-[5] and 
references therein). 

The topic of this paper is the convergence rate of distributed consensus protocols in graphs 
with fixed (time invariant) topology. The convergence rate is extremely important; it determines 
practical applicability of the protocol. If the convergence rate is small, it will take many iterations 
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before the states of all agents are sufficiently close. Compared to the vast literature on design of 
consensus protocols, however, the literature on convergence rate analysis is meager. Convergence 
rate of distributed consensus in time- varying graphs have been studied in [6]-[8]. The related 
problem of mixing time of Markov chains is studied in [9]. In [10], convergence rate for a 
specific class of graphs, that we call L-Z geometric graphs, are established as a function of the 
number of agents. In general, the convergence rate of consensus algorithms tend to be slow, and 
decreases as the number of agents increases. It is shown in [11] that the convergence rate can 
be arbitrarily fast in small-world networks. However, networks in which communication is only 
possible between agents that are close enough are not likely to be small-world. 

One of the seminal works on this subject is convex optimization of weights on edges of the 
graph to maximize the consensus convergence rate [12], [13]. Convex optimization imposes the 
constraint that the weights of the graph must be symmetric, which means any two neighboring 
agents put equal weight on the information received from each other. The convergence rate of 
consensus protocols on graphs with symmetric weights degrades considerably as the number of 
agents in the network increases. In a D-dimensional lattice, for instance, the convergence rate is 
0(l/N 2 / D ) if the weights are symmetric, where N is the number of agents. This result follows 
as a special case of the results in [10]. Thus, the convergence rate becomes arbitrarily small if 
the size of the network grows without bound. 

In [14]— [16], finite-time distributed consensus protocols are proposed to improve the per- 
formance over asymptotic consensus. However, in general, the finite time needed to achieve 
consensus depends the number of agents in the network. Thus, for large size of networks, 
although consensus can be achieved in finite time, the time needed to reach consensus becomes 
large. 

In this paper, we study the problem of how to increase the convergence rate of consensus 
protocols by designing asymmetric weights on edges. We first consider lattice graphs and derive 
precise formulae for convergence rate in these graphs. In particular, we show that in lattice 
graphs, with proper choice of asymmetric weights, the convergence rate of distributed consensus 
can be bounded away from zero uniformly in N. Thus, the proposed asymmetric design makes 
distributed consensus highly scalable. In addition, we provide exact formulae for asymptotic 
steady-state consensus value. With asymmetric weights, the consensus value in general is not 
the average of the initial conditions. 
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We next propose a weight design scheme for arbitrary 2-dimensional geometric graphs, i.e., 
graphs consisting of nodes in M 2 . Here we use the idea of continuum approximation to extend the 
asymmetric design from lattices to geometric graphs. We show how a Sturm-Liouville operator 
can be used to approximate the graph Laplacian in the case of lattices. The spectrum of the 
Laplacian and the convergence rate of consensus protocols are intimately related. The discrete 
weights in lattices can be seen as samples of a continuous weight function that appears in the 
S-L operator. Based on this analogy, a weight design algorithm is proposed in which a node 
i chooses the weight on the edge to a neighbor j depending on the relative angle between i 
and j. Numerical simulations show that the convergence rate with asymmetric designed weights 
in large graphs is an order of magnitude higher than that with (i) optimal symmetric weights, 
which are obtained by convex optimization [12], [13], and (ii) asymmetric weights obtained by 
Metropolis-Hastings method, which assigns weights uniformly to each edge connecting itself 
to its neighbor. The proposed weight design method is decentralized, every node can obtain 
its own weight based on the angular position measurements with its neighbors. In addition, it 
is computationally much cheaper than obtaining the optimal symmetric weights using convex 
optimization method. The proposed weight design method can be extended to geometric graphs 
in M D , but in this paper we limit ourselves to IR 2 . 

The rest of this paper is organized as follows. Section II presents the problem statement. 
Results on size-independent convergence rate on lattice graphs with asymmetric weight are stated 
in Section III. Asymmetric weight design method for more general graphs appear in Section IV. 
The paper ends with conclusions and future work in Section V. 

II. Problem statement 

To study the problem of distributed linear consensus in networks, we first introduce some 
terminologies. The network of N agents is modeled by a graph G = (V, E) with vertex set 
V = {1, . . . , N} and edge set E C V x V. We use (i,j) to represent a directed edge from 
i to j. A node i can receive information from j if and only if (i,j) E E. In this paper, we 
assume that communication is bidirectional, i.e. (i,j) E E if and only if (j,i) E E. For each 
edge (i,j) E E in the graph, we associate a weight Wij > to it. The set of neighbors of i is 
defined as M% '■= {j E V : (i,j) E E}. The Laplacian matrix L of an arbitrary graph G with 
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edge weights Wij is defined as 



Li,j 



Ek=iWi, k i = j,(i,k)eE, (1) 

otherwise. 

A linear consensus protocol is an iterative update law: 

Xl {k + 1) = W hl Xi{k) + J2 W hJ x i( k )i i e V ' ( 2 ) 

with initial conditions x«(0) G K, where k = {0, 1, 2, • • • } is the discrete time index. Following 
standard practice we assume the weight matrix W is a stochastic matrix, i.e. W iy j > and 
Wl = 1, where 1 is a vector with all entries of 1. The distributed consensus protocol (2) can 
be written in the following compact form: 

x(k + l) = Wx(k), (3) 

where x(k) = [xi(k), X2(k), ■ ■ ■ , XN(k)] T is the states of the iV agents at time k. It's straightfor- 
ward to obtain the following relation L = I — W, where / is the N x N identity matrix and L 
is the Laplacian matrix associated with the graph with Wij as its weights on the directed edge 
(i,j). In addition, their spectra are related by a(L) = 1 — a(W), i.e. fie(L) = 1 — Xi(W), where 
£ E {1, 2, • ■ ■ , N} and \x^ \i are the eigenvalues of L and W respectively. The linear distributed 
consensus protocol (3) implies x(k) = W k x(0). We assume W is strong connected (irreducible) 
and primitive. In that case the spectral radius of W is 1 and there is exactly one eigenvalue on 
the unit disk. Let n G M lx7V be the left Perron vector of W corresponding to the eigenvalue of 
1, i.e. ttW = ix, iii > and J2i=i ^1 = 1, we have 

lim W k = Itt, (4) 

k— >oo 

Therefore, all the states of the N agents asymptotically converge to a steady state value x as 

k — > oo, 

lim x(k) = l7rx(0) = lx, (5) 

k— >oo 

where x = Y^=i n i x i^)- 

One of the most important feature of linear distributed consensus is the rate of convergence 
to its steady state value. It's well known that for a primitive stochastic matrix, the rate of 
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convergence R can be measured by the spectral gap R — 1 — p(W), where p(W) is the essential 
spectral radius of W, which is defined as 

p(W) := max{|A| : A G a(W) \ {1}}. 

If the eigenvalues of W are real and they are ordered in a non-increasing fashion such that 
1 = Ai>A 2 >--->Ajv, then the convergence rate of W is given by 

R = 1 - p{W) = min{l - A 2 , 1 + A^}. (6) 

In addition, from Gerschgorin circle theorem, we have that A^ > — 1 + 2 max, Wa. If maxj Wu ^ 
0, then 1 + Aat is a constant bounded away from 0. Therefore, the key to find a lower bound for 
the convergence rate of W is to find an upper bound on the second largest eigenvalue A 2 of W. 
Equivalently, we can find a lower bound of the second smallest eigenvalue /i 2 of the associated 
Laplacian matrix L, since /^ 2 = 1 — A 2 . 

Definition 1: We say a graph G has symmetric weights if Wij = Wjj for each pair of 
neighboring agents (i,j) E E. Otherwise, the weights are called asymmetric. □ 

If the weights are symmetric, the matrix W is doubly stochastic, meaning that each row and 
column sum is 1. 

The following theorem summaries the results in [10] on the convergence rate of consensus 
with symmetric weights in a broad class of graphs that include lattices. A D-dimensional lattice, 
specifically a Ni x N 2 x • • • x N D lattice, is a graph with N = Ni x N 2 x • • • x N D nodes, in 
which the nodes are placed at the integer unit coordinate points of the D-dimensional Euclidean 
space and each node connects to other nodes that are exactly one unit away from it. A D- 
dimensional lattice is drawn in IR D with a Cartesian reference frame whose axes are denoted by 
%i, X2, • ■ ■ ,Xd- We call a graph is a L-Z geometric graph if it can be seen as a perturbation of 
regular lattice in D-dimensional space; each node connects other nodes within a certain range. 
The formal definition is given in [10]. 

Theorem 1: Let G be a D-dimensional connected L-Z geometric graph or lattice and let W 
be any doubly stochastic matrix compatible with G. Then 

<R<^, (V) 



N 2/D - - N 2/D ' 

where N is the number of nodes in the graph G and ci, c 2 are some constants independent of 

N. □ 
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The above theorem states that for any connected L-Z geometric/lattice graph G, the convergence 
rate of consensus with symmetric weights cannot be bounded away from uniformly with the 
size N of the graph. The convergence rate of the network becomes arbitrarily slow as N increases 
without bound. The loss of convergence rate with symmetric information graph has also been 
observed in the vehicular formation [17], [18]. In fact, another important conclusion of the result 
above is that heterogeneity in weights among nodes, as long as W is symmetric, does not change 
the asymptotic scaling of the convergence rate. At best it can change the constant in front of the 
scaling formula (see [9] also). Therefore, even centralized weight optimization scheme proposed 
in [12], [13] - that constrain the eights to be symmetric in order to make the optimization problem 
convex - will suffer from the same issue as that of un-optimized weights on the edges. Namely, 
the convergence rate will decay as 0(1/N 2 / D ) in a £)-dimensional lattice/L-Z geometric graph 
even with the optimized weights. In the rest of the paper, we study the problem of speeding up 
the convergence rate by designing asymmetric weights. 

III. Fast consensus on D -Dimensional lattices 

First we establish technical results (whose proofs are provided in the appendix) on the spectrum 
and Perron vectors of D-dimensional lattices with asymmetric weights on the edges. We then 
summarize their design implications at the end of section III-A. 

A. Asymmetric weights in lattices 

We first consider distributed consensus on a 1 -dimensional lattice. This will be useful in 
generalizing to D-dimensional lattices. Each agent interacts with its nearest neighbors in the 
lattice (one on each side). Its information graph is depicted in Figure 1. The updating law of 
agent i is given by 

xt(k + 1) = W iti Xi(k) + W^i-iXi-iik) + Wi ii+1 x i+1 (k). 

where i G {2, 3, • • • , TV — 1}. The updating laws of the 1-st and A-th agents are slightly different 
from the above equation, since they only have one neighbor. 
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JV-1 
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Wn-i,n 



X\ 



Fig. 1. Information graph for a 1-D lattice of N agents. 



The weight matrix W^ for the 1 -dimensional lattice is tridiagonal: 

Xi w lt2 

W 2 ,l W 2 ,2 W 2 ,3 

Wn-i,n-2 Wn-i,n-i Wn-: 
Wn,n-i Wn,n 
The following lemma gives the spectrum and the left-hand Perron vector for the weight matrix 

Lemma 1: Let W^ be the weight matrix associated with the 1-dimensional lattice with the 
weights given by W iti+ i = c, W i+ i^ = a, where a ^ c are positive constants and a + c < 1. 
Then its eigenvalue are 

(£-l)vr 



Ai 



A, 



1 — a — c + 2 v ac cos 



iV 



where £ G {2, • • • , iV}, and its left Perron vector is 



7T 



1 — c/a 



-[1, c/a, (c/a)' 



(c/a)"- 1 ]. 



l-(c/a)^ 
We next consider consensus on a D-dimensional lattice with the following weights 



W U d+ = c d , W U d 



a d , 



D 



(8) 



^« 



where a d ^ Cd are positive constants and J2d=i a d + c d < 1- The notation z d+ denotes the 
neighbor on the positive Xd axis of node i and i d ~ denotes the neighbor on the negative Xd axis 
of node i. For example, 2 1+ and 2 1_ in Figure 2 denote node 3 and node 1, respectively, and 
2 2+ is node 5. 
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«L> 




(2) (2) 

Fig. 2. A pictorial representation of a 2-dimensional lattice information graph with the weights W d+ — Cd, W d _ = <2d, 
where d — 1, 2. 



Lemma 2: Let W^ be the weight matrix associated with the D-dimensional lattice with the 
weights given in (8). Then its eigenvalues are given by 

D 



A/^Hl-^l-A^wf)), 



d=l 

where £= (£ 1 , £ 2 , - - , £ D ), in which £ d e {1, 2, ■ ■ • , N d } and WJp is the N d x N d weight matrix 
associated with a 1-dimensional lattice with the weights given by W d '(i,i + 1) = c d , W^ \i + 
1, i) = a d and i G {1, ■ • • , N d — 1}. Its left Perron vector is tx = n D <g> ^1]^ <E> • • • <8> vrj , where 
n d ' is the left Perron vector of PVj . □ 

The next theorem shows the implications of the preceding technical results on the convergence 
rate in D-dimensional lattices. 

Theorem 2: Let G be a D-dimensional lattice graph and let W^ be an asymmetric stochastic 
matrix compatible with G with the weights given in (8). Then the convergence rate satisfies 



R > c , 



(9) 



where c G (0, 1) is a constant independent of N. □ 

Remark 1: Recall from Theorem 1, for any L-Z geometric or lattice graphs, as long as the 
weight matrix W is symmetric, no matter how do we design the weights Wij, the convergence 
rate becomes progressively smaller as the number of agents N increases, and it cannot be 
uniformly bounded away from 0. In contrast, Theorem 2 shows that for lattice graphs, asymmetry 
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in the weights makes the convergence rate uniformly bounded away from 0. In fact, any amount of 
asymmetry along the coordinate axes of the lattice (ad ^ q), will make this happen. Asymmetric 
weights thus make the linear distributed consensus law highly scalable. It eliminates the problem 
of degeneration of convergence rate with increasing N. 

The second question is where do the node states converge to with asymmetric weights? Recall 
that the asymptotic steady state value of all agents is x = J2 i= i^iXi(0). For a lattice graph, 
its Perron vector ix is given in Lemma 1 and Lemma 2. Thus we can determine the steady 
state value x if the initial value x(0) is given. This information is particularly useful to find 
the rendezvous position in multi-vehicle rendezvous problem. On the other hand, we see from 
Lemma 1 and Lemma 2 that if a^ ^ a, then iXi ^ -k, which implies the steady-state value is not 
the average of the initial values. The asymmetric weight design is not applicable to distributed 
averaging problem. □ 

B. Numerical comparison 

In this section, we present the numerical comparison of the convergence rates of the distributed 
protocol (3) between asymmetric designed weights (Theorem 2) and symmetric optimal weights 
obtained from convex optimization [12], [13]. For simplicity, we take the 1-D lattice as an 
example. The asymmetric weights used are W iji+ i = c = 0.3, W i+ i ti = a = 0.2. We see from 
Figure 3 that the convergence rate with asymmetric designed weights is much larger than that with 
symmetric optimal weights. In addition, given the asymmetric weight values c = 0.3, a = 0.2, 
we obtain from Lemma 1 that A 2 < 0.5 + 2V0.06, X^ > 0.5 + 2\/0.06, which implies 

R = min{l-X 2 ,l + \ N } > 0.5 - 2v / 0JD6. (10) 

We see from Figure 3 that the convergence rate R is indeed uniformly bounded below by (10). 

IV. Fast consensus in more general graphs 

In this section, we study how to design the weight matrix W to increase the convergence 
rate of consensus in graphs that are more general than lattices. We use the idea of continuum 
approximation. Under some "niceness" properties, a graph can be thought of as approximation 
of a .D-dimensional lattice, and by extension, of the Euclidean space corresponding to ~§l D [19]. 
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Fig. 3. Comparison of convergence rate of 1-D lattice between asymmetric design and convex optimization (symmetric optimal). 



These properties have to do with the graph not having arbitrarily large holes etc. Precise 
conditions under which a graph can be approximated by the D-dimensional lattice are explored 
in [20] (for infinite graphs) and in [10] (for finite graphs). The dimension D of the corresponding 
lattice/Euclidean space is also determined by these properties. 

The key is to embed the discrete graph problem into a continuum-domain problem. We use 
a Sturm-Liouville operator to approximate the Laplacian matrix of a D-dimensional geometric 
graph. A D-dimensional geometric graph is simply a graph with a mapping of nodes to points in 
M D . Based on this approximation, we re-derive the asymmetric weights for lattices described in 
the previous section as values of continuous functions defined over IR D along the principal axes 
in M D . In a lattice, the neighbors of a node lie along the principal canonical axes of ~R D . For an 
arbitrary graph, the weights are now chosen as samples of the same functions, along directions 
in which the neighbors lie. 

The method is applicable to arbitrary dimension, but we only consider the 2-D case in this 
paper. Graphs with 2-D drawings are one of the most relevant classes of graphs for sensor 
networks where consensus is likely to find application. 
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Fig. 4. Continuum approximation of general graphs. 

A. Continuum approximation 

Recall that the convergence rate is intimately connected to the Laplacian matrix. We will 
show that the Laplacian matrix associated with a large 2-D lattice with certain weights can 
be approximated by a Sturm-Liouville operator defined on a 2-D plane. Thus it's reasonable 
to suppose that the Sturm-Liouville operator is also a good (continuum) approximation of the 
Laplacian matrix of large graphs with 2-D drawing. We start from 2-D lattice graph and derive 
a Sturm-Liouville operator. We then use this operator to approximate the graph Laplacian of 
more general graphs. The idea is illustrated in Figure 4. 

For ease of description, we first consider a 1-D lattice, with the following asymmetric weights 
inspired by [21], 

l + e „. 1-e 



W, 



M+i 



Wi 



i+l,i 



(ID 



2 ' " ' 2 

where i E {1, 2, ■ • • , N — 1} and e E (0, 1) is a constant. The graph Laplacian corresponding to 
the weights given in (11) is given by 



L« 



l+e 
2 


-1-e 

2 








-l+e 
2 


1 


-1-e 

2 










-l+e 
2 


1 

-l+e 
2 


-1-e 
2 

1-e 
2 . 



(12) 



Recall that to find a lower bound of the convergence rate of the weight matrix W^\ it's sufficient 
to find a lower bound of the second smallest eigenvalue of the associate Laplacian matrix l/ 1 ). 
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We now use a Sturm-Liouville operator to approximate the Laplacian matrix LS 1 '. We first 
consider the finite-dimensional eigenvalue problem L^<p = fJ>(j>, 



l+e -1-e 
2 2 

-l+e l 



-1-e 



-l+e 



1 zdz^ 

A 2 

-l+e 1-e 

2 2 J 





' 01 " 




' 01 ' 




02 


= /i 


02 




0AT-1 




0JV-1 




. 0^ . 




_ 4>N _ 



Expanding the equation, we have the following coupled difference equations 



■l + e, , -1-e 

t»t_i + (pi + 



'i+1 



2 r T 2 

where z E {1, 2, ■ • • , ^} and O = 0i, 0jv+i = 0jv- The above equation can be rewritten as 

1 (pj-x - 2<pi + (p, l+x e (p i+ i - (p t _i 
2N 2 1/N 2 N 2/N ~ m ' 

The starting point for the continuum approximation is to consider a function <p{x) : [0, 1] — > 

that satisfies: 



(X)\x=i/{N+1), 



(13) 



such that functions that are defined at discrete points i will be approximated by functions that are 
defined everywhere in [0, 1]. The original functions are thought of as samples of their continuous 
approximations. Under the assumption that iV is large, using the following finite difference 
approximations: 



frj-i ~ 20» + m 
1/N 2 

H+l — 0i-l 

2/N 



d 2 4>{x,t) 

dx 2 
d(p{x,t) 

dx 



=i/(N+l) 



x=i/(N+l) 



the finite-dimensional eigenvalue problem can be approximated by the following Sturm-Liouville 
eigenvalue problem 

Id 2 e d 



£ {1) (f)(x) = fi<j)(x), £ {1) = ■ 

with the following Neumann boundary conditions 

#(0) d(f)(l) 



dx 



dx 



2N 2 dx 2 Ndx' 



0. 



(14) 



(15) 
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Lemma 3: The eigenvalues of the Sturm-Liouville operator £W (14) with boundary condi- 
tion (15) for < e < 1 are real and the first two smallest eigenvalues satisfy 

M£ (1) ) = 0, /i 2 (£ (1) )>e 2 /2. □ 

We see from Lemma 3 that the second smallest eigenvalue of the Sturm-Liouville operator 

D- 1 ' is uniformly bounded away from zero. This result is not surprising, since it's a continuum 

counterpart of Lemma 1, which shows that the second smallest eigenvalue corresponding to the 

1-D lattice with designed asymmetric weights is uniformly bounded below. 

We now consider the distributed consensus on D-dimensional lattices. In particular, we consider 
the following weights on the graph 

W^ + = c d = i±£ , W {D l=a d = ^, (16) 

where £ 6 (0, 1) is a constant. 

The Laplacian matrix of the D-dimensional square lattices with the weights given in (16) is 
given by L^ = I — W^ D \ Following the similar procedure as the 1-dimensional lattice, the 
second smallest eigenvalue of the Laplacian matrix l/ D ) can be approximated by that of the 
following Sturm-Liouville operator 

/rj\ ^ — \, 1 & £ Qj . 

= ~^ i { 2DNld^ d + DN' d d^ d h (17) 

with the following Neumann boundary conditions 

d(p(x 



= 0, (18) 

£,v=0 or 1 



dx d 
where d — 1, 2, • • • , D and x — [x\, x 2 , • ■ ■ , x D ] T . 

The continuum approximation has been used to study the stability margin of large vehicular 
platoons [21], [22], in which the continuum model gives more insight on the effect of asymmetry 
on the stability margin of the systems. In this paper, we use the second smallest eigenvalue of 
the Sturm-Liouville operator C^ to approximate that of the Laplacian matrix L^ D \ 

Theorem 3: The second smallest eigenvalues fi 2 (£^) of the Sturm-Liouville operator C^ (17) 
with boundary condition (18) for < £ < 1 is real and satisfies 

^{C (D) ) > tJ, (19) 

which is a positive constant independent of N. D 
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Fig. 5. Weight design for general graphs. 



B. Weight design for general graphs 

The inspiration of the proposed method comes from the design for lattices. The 4 weights 
for each node i in a 2-D lattice can be re-expressed as samples of a continuous function g : 



[0,27r)-> r 



4 ' 4 



WV+ = S^v 1 "^ 



Wtf a+ = g(0 iti 2+), 



W, 



i,i^ 



9( 



'i,i ii 



W itfl - 



9\ 



where 9ij is the relative angular position of j with respect to i. Given the angular positions of 
i's neighbors and the values of the weights, we know that the function g must satisfy: 



, r . 7T 37T r l+£ l + £ 1 — £ 1 — £. 

g{% g > 7r > y]) = [-4-' -4-' -4-' ~i- ] 



(20) 



Thus, we choose the function g as shown in Figure 5 (b). 

For an arbitrary graph, we now choose the weights by sampling the function according to the 
angle associated with each edge (i,j): 

g{Qi,k) 



W, 



i.k 



(21) 



where g(-) is the function described in Figure 5 (b). The above weight function (21) can be seen 
as a linear interpolation of (20). We see from (21) that the weight on each edge is computable in a 
distributed manner; a node only needs to know the angular position of its neighbors. This design 
method does not require any knowledge of the network topology or centralized computation. 
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C. Numerical comparison 

In this section, we present the numerical comparison of convergence rates among asymmetric 
design, symmetric optimal weights and weights chosen by the Metropolis-Hastings method. 
The symmetric optimal weights are obtained by using convex optimization method [9], [12]. 
The Metropolis-Hastings weights are picked by the following rule: W^j = l/|A/i|, where jVj 
denotes the number of node z's neighbors. The weights generated by this method are in general 
asymmetric. We plot the convergence rate R as a function of N, where N is the number of 
agents in the network. The amount of asymmetry used is e = 0.5. 








(a) L-Z geometric (b) Delaunay 

Fig. 6. Examples of 2-D L-Z geometric, Delaunay and random geometric graphs. 



(c) Random geometric 



We first consider a L-Z geometric graph [10], which is generated by perturbing the position of 
a square 2-D lattice (Ni = N 2 = \/N) with Gaussian random noise (zero mean and l/(4y/N~) 
standard deviation) and connect each nodes with the other nodes that are within 2/\/N of 
radius neighborhood. Second, we consider a Delaunay graph [5], which is generated by placing 
N nodes on a 2-D unit square uniformly at random and connecting any two nodes if their 
corresponding Voronoi cells intersect, as long as their Euclidean distance is smaller than 1/3. 
Finally, we consider a random geometric graphs [23], which is generated by placing N nodes 
on a 2-D unit square uniformly at random and connecting pairs of nodes that are within distance 
3/\^N of each other. Figure 6 gives examples of L-Z geometric graphs, Delaunay graphs and 
random geometric graphs. 
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(c) Random geometric graphs 



Fig. 7. Comparison of convergence rates with proposed asymmetric weights, Metropolis-Hastings weights, and symmetric 
optimal. For each N, results from 5 sample graphs are plotted. 
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Fig. 8. Mean of convergence rates of L-Z geometric, Delaunay and random geometric graphs with asymmetric design (AS) 
and Metropolis-Hastings (MH) for large N computed from 10 samples. 



Figure 7 shows the comparison of convergence rates among asymmetric design, symmetric 
optimal and Metropolis-Hastings weights. For each N, the convergence rate of 10 samples of 
the graphs are plotted. We see from Figure 7 that for almost every sample in each of the three 
classes, the convergence rate with the asymmetric design is an order of magnitude larger than the 
others, especially when N is large. In addition, the convergence rates with symmetric optimal 
and Metropolis-Hastings methods are similar. Moreover, we observe from Figure 8 (a) and (c) 
that the slopes of the convergence rates with asymmetric design for L-Z geometric graphs and 
random geometric graphs are becoming progressively smaller with increasing N, which indicates 
that the convergence rate has a potential to be uniformly bounded below when N becomes 
arbitrarily large. The convergence rates with symmetric optimal weights are not included, since 
the numerical computations for large N are extremely expensive. 

V. Conclusions and Future work 

We studied the problem of how to design weights to increase the convergence rate of distributed 
consensus in networks with static topology. We proved that on lattice graphs, with proper choice 
of asymmetric weights, the convergence rate can be uniformly bounded away from zero. In 
addition, we propose a distributed weight design algorithm for 2-dimensional geometric graphs 
to improve the convergence rate, by using a continuum approximation. Numerical calculations 
show that the resulting convergence rate is substantially larger than that optimal symmetric 
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weights and Metropolis Hastings weights. 

An important open question is a precise characterization of graphs for which theoretical 
guarantees on size-independent convergence rate can be provided with the proposed design. In 
addition, characterizing the asymptotic steady state value for more general graphs than lattices 
is also on-going work. 

References 

[1] J. Tsitsiklis, "Problems in decentralized decision making and computation." Ph.D. dissertation, Massachusetts Institute of 

Technology, 1984. 
[2] A. Jadbabaie, J. Lin, and A. Morse, "Coordination of groups of mobile autonomous agents using nearest neighbor rules," 

IEEE Transactions on Automatic Control, vol. 48, no. 6, pp. 988-1001, 2003. 
[3] R. Olfati-Saber, J. Fax, and R. Murray, "Consensus and cooperation in networked multi-agent systems," Proceedings of 

the IEEE, vol. 95, no. 1, pp. 215-233, 2007. 
[4] W. Ren and R. Beard, Distributed consensus in multi-vehicle cooperative control: theory and applications. Springer 

Verlag, 2008. 
[5] S. Martinez, J. Cortes, and F. Bullo, "Motion coordination with distributed information," Control Systems Magazine, IEEE, 

vol. 27, no. 4, pp. 75-88, 2007. 
[6] A. Olshevsky and J. N. Tsitsiklis, "Convergence speed in distributed consensus and averaging," S1AM J. Control and 

Optimization, vol. 48, no. 1, pp. 33-55, 2009. 
[7] T. Chan and L. Ning, "Fast convergence for consensus in dynamic networks," Automata, Languages and Programming, 

pp. 514-525, 2011. 
[8] M. Cao, D. Spielman, and A. Morse, "A lower bound on convergence of a distributed network consensus algorithm," in 
Decision and Control, 2005 and 2005 European Control Conference. CDC-ECC'05. 44th IEEE Conference on. IEEE, 
2005, pp. 2356-2361. 
[9] S. Boyd, P. Diaconis, and L. Xiao, "Fastest mixing markov chain on a graph," SIAM review, pp. 667-689, 2004. 
[10] E. Lovisari and S. Zampieri, "Performance metrics in the average consensus problem: a tutorial," February 2012, annual 

Reviews in Control. 
[1 1] R. Olfati-Saber, "Ultrafast consensus in small-world networks," in American Control Conference, 2005. Proceedings of the 

2005. IEEE, 2005, pp. 2371-2378. 
[12] L. Xiao and S. Boyd, "Fast linear iterations for distributed averaging," Systems & Control Letters, vol. 53, no. 1, pp. 

65-78, 2004. 
[13] S. Boyd, "Convex optimization of graph Laplacian eigenvalues," in Proceedings of the International Congress of 

Mathematicians, vol. 3. Citeseer, 2006, pp. 1311-1319. 
[14] Y. Cao and W. Ren, "Finite-time consensus for second-order multi-agent networks with inherent nonlinear dynamics under 

an undirected fixed graph," in Proceedings of the 50th IEEE conference on Decision and Control, 2011. 
[15] L. Wang and F. Xiao, "Finite-time consensus problems for networks of dynamic agents," Automatic Control, IEEE 

Transactions on, vol. 55, no. 4, pp. 950-955, 2010. 
[16] S. Sundaram and C. Hadjicostis, "Finite-time distributed consensus in graphs with time-invariant topologies," in American 
Control Conference, 2007., 2007, pp. 711-716. 

February 26, 2013 DRAFT 



19 



[17] H. Hao and P. Barooah, "Control of large ID networks of double integrator agents: role of heterogeneity and asymmetry 

on stability margin," in IEEE Conference on Decision and Control, December 2010. 
[18] P. Barooah, P. G. Mehta, and J. P. Hespanha, "Mistuning-based decentralized control of vehicular platoons for improved 

closed loop stability," IEEE Transactions on Automatic Control, vol. 54, no. 9, pp. 2100-2113, September 2009. 
[19] P. G. Doyle and J. L. Snell, "Random walks and electric networks," Math. Assoc, of America, 1984. 
[20] P. Barooah and J. P. Hespanha, "Error scaling laws for optimal estimation from relative measurements," IEEE Transactions 

on Information Theory, vol. 55, pp. 5661 - 5673, December 2009. 
[21] H. Hao and P. Barooah, "Asymmetric control achieves size-independent stability margin in 1-d flocks," in 50th IEEE 

Conference on Decision and Control and European Control Conference, December 2011, pp. 3458-3463. 
[22] H. Hao, P. Barooah, and P. G. Mehta, "Stability margin scaling laws of distributed formation control as a function of 

network structure," IEEE Transactions on Automatic Control, vol. 56, pp. 923 - 929, April 2011. 
[23] S. Boyd, A. Ghosh, B. Prabhakar, and D. Shah, "Randomized gossip algorithms," IEEE Transactions on Information 

Theory, vol. 52, no. 6, pp. 2508-2530, 2006. 
[24] W. Yueh and S. Cheng, "Explicit eigenvalues and inverses of tridiagonal toeplitz matrices with four perturbed corners," 

The Australian & New Zealand Industrial and Applied Mathematics (Anziam) Journal, vol. 49, no. 3, pp. 361-388, 2008. 
[25] R. Haberman, Elementary applied partial differential equations: with Fourier series and boundary value problems. 

Prentice-Hall, 2003. 
[26] L. Evans, Partial Differential Equations: Second Edition (Graduate Studies in Mathematics). American Mathematical 

Society, 2010. 

Appendix 

Proof of Lemma 1. The stochastic matrix W^ has a simple eigenvalue Ai = 1. Following 
Theorem 3.1 of [24], the other eigenvalues of W^ are given by 



\i = 1 - a -c + 2y/ac cos 9i, £ e {2, • • • ,N}, 
where 9g (9 ^ mir, m E Z, Z being the set of integers) is the root of the following equation 

2 sin(N9)cos(9) = (a + c) \j — - sin N6, 
which implies 

sin(iV0) = 0, or cose? 



ac 



(a + c) 




2 V ac 
( a + c ) . /X ^ 1 t u, lc ™ a o a- ( a + c ) . fl 



Since a > 0, c > and a ^ c, we have ^r^x — > 1, thus cos6> ^ ■ L -ir i \/ — ■ In addition, we 

' ' ' 2 y ac ' ' 2 y ac 

have that 9 ^ mix, which yields 

(£- l)n 
0e= K N ' , e = {2,---,N}. (22) 
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We now obtain the eigenvalues of W^\ which is given by 

(£ — 1W 

\ e = 1 - a - c + 2V/OCCOS - — — — , l = {2, • • • , N}. 

Let it = [vr 1; 7r 2 , • • • , 7t N ] be the left Perron vector of W^\ From the definition of Perron vector, 
we have irW^ 1 ' = n. Thanks to the special structure of the tridiagonal form of W^\ we can 
solve for n explicitly, which yields 



Tli = (c/a) 1 7Ti 



(23) 



^iV 



where i 6 {2, 3, • • • , N}. In addition, we have i\i > and ^2 i=l 7Tj = 1. Therefore, 

N N 

1 = ^2 7T i = ^2{c/a) i - 1 7r 1 => 7Ti 



1 — c/a 



Substituting the above equation into (23), we complete the proof. ■ 

Proof of Lemma 2. With the weights given in (8), it is straightforward - through a bit tedious - to 
show that the graph Laplacian L^ associated with the D-dimensional lattice has the following 
form: 

L& = I Nd <g> L^ 1 ) + I® ® I Nl N 2 -N d ^ 2<d<D, 

where l/ 1 ) = L\ and L d = 1 — W d is the Laplacian matrix of dimension Nj x Nd, which 
is given by 

Cd -c d 

-a d a d + c d -c d 



(i) 



(24) 



-a d a d + c d -c d 
—ad (id _ 

Since a D-dimensional lattice is the Cartesian product graph of D 1-dimensional lattices, the 
eigenvalues of the graph Laplacian matrix L^ are sum of the eigenvalues of the D 1-dimensional 
Laplacian matrix L d . Thus, we have 

D 



d i 



d=\ 
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In addition, we have that W^ = I N — L^ D "> and W^ = ijv d — L d , thus the eigenvalues A^of 
\y( D ) are given by 



d=l 
D 



i-E^-^W))- 



y i - s\ id yvv 
d=l 
r (l) ~ „(!) ^ ^ „(1) 



To see 7T = 7i£> <8> ^d-i <H> ■ ■ • <8> vr| is the left Perron vector of W^ D \ we first notice that 

JX) w Vl-JXl _(i)r(i)_ n 

^d ^d — ^d > ^d -^d - u ' 

where d G {1, • • • ,-D}. The rest of the proof follows by straightforward induction method, we 
omit the proof due to space limit. ■ 

Proof of Lemma 3. Multiply both sides of (14) by 2N 2 e 2eNx , we obtain the standard Sturm- 
Liouville eigenvalue problem 

d r 2ENx d^x)\ + 2N 2^n X(J){x) = (25) 

ax \ ax J 

According to Sturm-Liouville Theory, all the eigenvalues are real, see [25], [26]. To solve the 
Sturm-Liouville eigenvalue problem (14)-(15), we assume solution of the form, (j)(x) = e rx , then 
we obtain the following equation 

r 2 + 2eNr + 2/jN 2 = 0, 

=>r = N(-e±y/e 2 -2fj). (26) 

Depending on the discriminant in the above equation, there are three cases to analyze: 



1) /x < e 2 /2, then the eigenfunction <j)(x) has the following form <f>(x) = cie N (~ 6+ v e2 ~ 2 ^ x + 
c 2 e N (~ £ ~v £2 ~ 2 ^ x , where c±, c 2 are some constants. Applying the boundary condition (15), 
it's straightforward to see that, for non-trivial eigenfunctions <p(x) to exit, the following 
equation must be satisfied 



- Je 2 - 2/x = 2Ny /~iZ 2 -^-e + y / e 2 -2fi 



e + y/e 2 - 2fi e + y/e 2 - 2/x 

Thus, we have fj, = 0. 
2) \x — e 2 /2, then the eigenfunction <j){x) has the following form 

(j)(x) = Cl e- £Nx + c 2 xe~ sNx . 
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Applying the boundary condition (15) again, it's straightforward to see that there is no 
eigenvalue for this case. 
3) /i > e 2 /2, then the eigenfunction has the following form 0(x) = e~ eNx (ci cos(N \/2/i — e 2 x) + 
c 2 sm(N^y2/j, — e 2 x). Applying the boundary condition (15), for non-trivial eigenfunctions 
to exit, the eigenvalues /i must satisfy /i = y + f^r, where £ = 1, 2, • • • . 
Combining the above three cases, the eigenvalues of the Sturm-Liouville operator are [i E 
{0, y + fjfr}, where £ E {1,2, •••}. The second smallest eigenvalue /U 2 (£) of the Strum- 
Liouville operator C is then given by 

e 2 vr 2 e 2 

^ (£) = y + 2iv^-y' 

which is a constant that is bounded away from 0. ■ 

Proof of Theorem 2. According to Lemma 1, the eigenvalues of W d are given by: 

Ai(^ (1) ) = 1, 

MWJ ) = 1 -a d - c d + 2^a d c d cos — ^— . 

From Lemma 2, the second largest eigenvalue ^(W^) and the smallest eigenvalue \n(W( d ^) 
of W^ D > are given by 

X 2 (W^) = 1~ max m (l-A 2 (^ (1) )) 

<1- max (a d + Q-2 A /a^Q), (27) 



Ajv(W^) = l-E^" W^)) 



D 



E. (N d -l)ir. 
(a d + c d - 2^a d c d cos ) 

d=i Nd 



D 



>l-^{a d + c d -2^E d ). (28) 

d=l 

Recall that R = min{l — A 2 , 1 + \n}- In addition, a d , c d are fixed constants and satisfy a d ^ c d , 
J2 d =i a d + c d < h therefore the lower bounds of 1 - \ 2 (W {D) ) and 1 + A A r(W /(Z)) ) are fixed 
positive constants. We then have that the convergence rate of W^ satisfy R = 1 — p{W^) > c , 
where c is a constant independent of N. ■ 
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Proof of Theorem 3. By the method of separation of variables [25], [26], the eigenvalues of the 
Sturm-Liouville operator C^ is given by 

D 

M£ (D) ) = $>(4 1} ), (29) 

(2=1 

.(1) 



where C d is the 1-dimensional Sturm-Liouville operator given by 

-(l) _ _}- (P_ _£ d_ 

d ~ 2DNjdx 2 d DN d dxd 

with Neumann boundary conditions. Following Lemma 3, we have that the smallest eigenvalue 

of C d is and the second smallest eigenvalue of C d is bounded below by C d > e 2 /2D. 

Therefore, we have from (29) that the second smallest eigenvalue is 
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